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1.  This  report  describes  the  results  of  one  task  performed  by  Syracuse 
University  under  contract  AF30602-71-C-0312.  The  objective  of  this 
task  was  to  provide  the  necessary  framework  for  practical  application  of 
reliability  tests  which  make  use  of  Information  available  before  the  test 
begins.  Such  tests  have  been  extensively  discussed  In  the  technical 
literature,  since  the  use  of  available  data  would  seem  to  make  It 
possible  to  reduce  test  time  without  loss  of  statistical  confidence. 

However,  the  discussions  have  produced  a great  deal  of  controversy 
which,  in  turn,  created  an  understandable  reluctance  on  the  part  of 
equipment  developers  to  apply  the  procedures.  Syracuse's  task  was  to 
develop  from  the  available  literature  a sound  approach  and  all  necessary 
procedures  to  permit  the  practical  application  of  a reliability  test  using 
prior  data.  They  fully  met  this  objective. 

2.  The  report  Is  comprehensive,  providing  guidance  In  selecting  appropriate 
test  risks  for  different  procurement  situations,  procedures  for  obtaining 
the  required  statistical  parameters  from  the  existing  data,  the  means  of 
determining  the  test  length  and  acceptance  criteria,  and  a sensitivity 
study  showing  the  effects  on  the  test  of  changes  In  the  prior  data. 

If  one  accepts  the  two  basic  assumptions  that  failures  will  follow  an 
exponential  distribution  and  that  the  prior  distribution  of  equipment 
mean-tlme-between-fallure  Is  an  Inverted  gamma,  there  can  be  no  controversy 
over  the  use  of  the  plans.  Neither  of  these  assumptions  can  be  guaranteed 
to  hold  In  all  cases,  but  both  are  considered  by  this  evaluator  as  quite 
reasonable.  Hence,  with  the  Information  In  this  report,  test  plans  can  be 
developed  and  applied  without  exceeding  the  bounds  of  reasonable  prudence. 
The  next  step  In  that  direction  will  be  the  creation  of  a document  which 
presents  the  Information  In  a form  which  can  be  easily  used  by  a program 
manager  to  develop  a test  plan  for  his  particular  situation. 


3.  Though  the  required  use  of  computer  programs  in  formulating  the  test 
plans  will  Impose  some  degree  of  difficulty  on  the  user,  RADC  Intends  to 
provide  an  exhibit  which  will  make  It  as  easy  as  possible  to  generate  test 
plans  which  take  advantage  of  prior  Information. 


Chief,  RAH  Engineering  Techniques  Section 
Reliability  Branch 
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PREFACE 


This  report  is  one  of  a set  of  five  presenting  the  results 
of  part  of  the  work  done  under  contract  number  F -3 0602-71-C-  0312. 
The  report  is  delivered  to  RADC  in  accordance  with  item  A006  of 
the  Contract  Data  Requirement  List.  Sponsorship  and  technical 


direction  of  this  task  originated  in  the  Reliability  and  Maintain- 
ability Engineering  Section  (A.  Coppola,  Chief) , Pliability  Branch 
(D.  Barber,  Chief) , within  the  Pliability  and  Compatibility  Division 
(J.  Naresky,  Chief)  of  the  Rome  Air  Development  Center.  Mr.  Anthony 
Coppola  was  the  Project  Engineer  who  was  technically  supported  by 
Mr.  Jerome  Klion. 


The  titles  of  the  reports  on  the  subject  "Pliability  Acceptance 
Sampling  Plans  Based  Upon  prior  Distribution"  are  as  follows: 

Volume  I.  Introduction  and  Problem  Definition. 

Risk  Criteria  and  Their  Interpretation. 

Implications  and  Determination  of  the  Prior  Distribution. 
Design  of  Testing  Plans. 

Sensitivity  Analyses. 


Volume  II. 
Volume  III. 
Volume  IV. 
Volume  V. 
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1.  INTRODUCTION  AND  PROBLEM  DEFINITION 


u 


Reliability  is  the  probability  of  a device  performing  its  function 
adequately  for  the  intended  period  of  time.  If  the  time  to  failure,  t, 
has  an  exponential  distribution  given  by 

f (t|0)  = ~ e*^9  ; t ^ 0,  0 > 0 (1) 

0 


then  the  following  measures  of  reliability  may  be  interchangeably  used. 
Reliability,  R(t)  = P(t  > T)  = e~T^9 
Mean  Time  Between  Failures  (MTHF)  = 0 


Hazard  Rate,  h(t)  = 1/0 

(l-p)th  pantile  of  Failure  Distribution,  tp  = - 6«np 
In  the  following  we  shall  take  0 as  the  measure  of  reliability. 

Two  types  of  life  tests  cure  generally  performed  to  ensure  that 
adequate  reliability  has  been  achieved.  These  are  demonstration  tests 
and  acceptance  sampling  tests.  Demonstration  tests  are  performed  to 
evaluate  the  lot  MIBF  with  respect  to  the  specified  MTBF,  0Q.  These  tests 
may  be  conducted  on  initial  production  samples  or  after  major  design  and 
development  changes  have  been  made.  After  production  starts,  acceptance 
sanpling  tests  are  performed  to  ensure  continuing  production  of  acceptable 
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equipments.  We  are  primarily  concerned  with  the  design  and  analysis 
of  acceptance  sampling  plans. 

The  situation  in  acceptance  sampling  is  typically  the  following. 
Accept/reject  decisions  are  to  be  made  regarding  a sequence  of  repairable 
systems  or  lots  containing  a large  ranter  of  components . The  decisions 
are  based  upon  test  results  subject  to  random  fluctuations.  A loss  is 
incurred  when  either  an  accept  or  a reject  decision  is  wrongly  taken. 
Further,  decisions  regarding  each  lot  or  system  are  taken  independently 
of  the  results  for  other  lots  or  systems. 

In  the  classical  context,  acceptance  sampling  plans  are  designed 
to  distinguish  between  two  values  of  6,  namely  the  minimum  acceptable 
MTBF  ex  and  the  specified  M1BF  0Q.  The  loss  corresponding  to  wrong 
decisions  is  quantified  by  the  producer's  risk  a = P (R| 6q)  and  the 
consumer's  risk  0 = P(A|e^)  where  A and  R denote  acceptance  and  rejection 
respectively.  In  this  context,  various  types  of  single  and  sequential 
sampling  plans  are  employed  to  limit  a and  0 to  specified  values.  For 
example,  a truncated  single  sample  plan  for  a system  is  vised  as 
follows.  The  plan  consists  of  placing  a system  on  a life  test  of  duration 
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T leading  to  an  accept  decision  if  the  observed  ranter  of  failures  r is 
less  than  or  equal  to  the  acceptance  ranter  r*.  The  design  of  a 
sanpling  plan  consists  of  obtaining  the  parameters  T and  r*  such  that 
the  specified  producer's  and  consumer's  risks  are  satisfied. 

The  classical  sampling  plans  have  the  disadvantage  that  they  do 
not  give  due  weight  to  the  frequency  with  which  different  values  of 
0 occur  in  practice  and  thereby  lead  to  risk  criteria  which  may  not 
be  very  meaningful  to  the  producer  and/or  the  oansimer.  In  practice, 
the  variability  casued  by  the  nature  of  the  production  process  is  likely 
to  be  such  that  the  values  of  0 differ  from  lot  to  lot.  Under  suitable 
assumptions,  the  variability  in  0 may  be  expressed  by  the  frequency 
distribution  for  6.  This  frequency  distribution,  g(6)  is  usually  called 
the  prior  distribution  of  0.  For  meaningful  results,  due  consideration 
should  be  given  to  g(0)  by  incorporating  it  in  the  design  of  sanpling 
plans. 

The  problem  under  consideration  in  this  study,  then,  is  the  design  and 
analysis  of  single  sample  reliability  acceptance  plans  for  exponential 
distribution  when  6 is  a randan  variable  with  distribution  g(8) . The 
four  facets  of  the  problem  are: 
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(a)  Interpretation  and  choice  of  appropriate  risk  criteria  to  meet 
producer's  and  consumer's  true  interests  in  various  situations  of 
practical  interest. 

(b)  Determination  of  the  functional  form  and  parameters  of  the  prior 
density. 

(c)  Design  of  single  sanple  truncated,  censored,  with  replacement 
and  without  replacement  plans  for  systems  and  lots.  The  design 
is  based  upon  exponential  failure  density,  using  the  appropriate 
prior  density  and  risk  criteria. 

(d)  Investigation  of  the  uncertainty  associated  with  prior  paraneters 
and  determination  of  the  effect  of  this  uncertainty  on  designed 
plans  and  risks. 

A summary  of  the  work  done  on  these  four  aspects  is  given  in  Section  3. 


I 
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2.  LITERATURE  REVIEW 


Three  somewhat  related  approaches  have  been  considered  in  the 
literature  toward  the  design  of  reliability  acceptance  sampling  plans 
based  upon  prior  kncwledge  regarding  0.  The  first  uses  the  posterior 
distribution  of  6 and  the  aooept/reject  decision  is  made  on  the  basis 
of  Bayesian  confidence  interval  for  0.  The  second  approach  is  to 
explicitly  define  the  producer's  and  consumer's  risks  using  g(0)  and 
then  to  design  the  plans  to  satisfy  these  risks.  The  thircj  approach 
converts  g(e)  into  pseudo  lumber  of  failures  and  pseudo  hours  of  test 
time.  Amongst  the  three,  the  second  approach  is  most  general  and 
meaningful  due  to  its  explicit  consideration  of  risks. 

One  of  the  earliest  efforts  toward  the  solution  of  this  problem 
using  the  first  approach  is  due  to  Pinkham  and  St.  James  (1963) . They 
considered  a known  two  point  prior  for  6 such  that  P(0  = eQ)  = tt  and 
P(0  = 6^)  = 1 - ir.  They  used  a classical  approach  with  P(r|6q)  = a 
and  P(A|0^)  = 8 such  that  the  probability  of  correct  identification 
is  equal  bo  ir(l-a)  + (l—rr ) (1-6).  The  risks  a and  6 were  chosen  to 
meet  a specified  probability  of  correct  identification  and  the  plans 
were  designed  to  satisfy  these  risks.  Bonis  (1966)  used  the  posterior 
distribution  of  6 to  make  the  aooept/reject  decision.  The  criterion 


was  to  accept  if  P(0  = 0Q|data)  = 1 - a.  It  should  be  noted  that  these 
two  procedures  do  not  adequately  take  into  consideration  the  producer's 
and  the  consumer's  risks. 

Following  the  second  approach,  the  design  of  fixed  time 
reliability  sanpling  plans  based  upon  the  producer's  and  oonsurer's 
risks  has  been  considered  by  Balaban  (1969) , Blunenthal  (1973) , 
Easterling  (1970) , Schick  and  Dmas  (1972)  and  Schafer  (1973) . The 


general  approach  taken  in  these  papers  is  to  treat  the  time  to  failure 


3S  having  an  exponential  distribution  and  to  use  the  oon jugate  prior, 


inverted  ganra,  for  the  parameter,  0.  The  producer's  and  the 
consumer's  risks  cure  defined  and  these  lead  to  two  simultaneous 
equations  in  test  time  T and  acceptance  number  r*.  The  test  plan  is 
obtained  by  ocnputing  (T,r*)  from  the  two  equations.  The  design 
criteria  proposed  by  these  authors,  in  our  notations,  are  given  below. 
Balaban  (1969): 

Producer’s  Risk:  P(R|0  = 0Q)  = a 

Consumer's  Risk:  P(e  « |A)  = 8* 

Easterling  (1970): 


Producer's  Risk:  P(r|0  2 0Q)  * a 

Consumer's  Risk:  P(A|6  £ 0^  = "fc 
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Schick  and  Drnas  (1972) : 


Producer's  Risk:  p(0  2 0q|r)  ■ a* 

Consumer's  Risk:  p(o  < e^A)  - 6* 

Schafer  (1971  and  1973) : 


Producer's  Risks:  P(R)  » 1 - p(A);  P(0  > 0_|R)  « a* 

1 u 

Qonsumer's  Risk:  P(6  4 0^|A)  ■ B* 

As  indicated  earlier,  the  third  approach  is  to  convert  the 
information  contained  in  the  prior  distribution  g(e)  into  equivalent 
test  hours  6 and  equivalent  muter  of  failures  41.  An  appropriate 
test  is  designed  to  obtain  T and  r*  to  satisfy  the  risks  a and  g. 

The  actual  test  procedure  is  to  conduct  the  test  for  (T-<5)  hours 
and  accept  if  the  nixiber  of  failures  is  less  than  or  equal  to 


(r*~4») . Such  plans  are  considered  by  Feduccia  (1970) , and  by  Guild 
(1973) . 

Schafer  and  Singpurwalla  (1969) , Barnett  (1972) , and  MacFarlarei 
(1971)  have  considered  the  design  of  sequential  reliability  demon- 
stration plans  using  prior  distribution.  The  criteria  suggested 

by  Schafer  et  al  and  Barnett  are  identical.  Fear  the  case  of  exponential 
failure  distribution  and  inverted  gairma  prior  density,  the  criterion 
is  to  accept  at  the  n th  stage  of  sequential  experimentation  if 


7 


P(e  > B-Je^  i ««*  reject  if  P(e  * ejS^)  < *2  en  is  the 
estimate  of  6 obtained  from  the  failure  data  at  the  n th  stage  and 
and  k2  are  two  prespecified  reed  numbers. 

MacFarland  (1971)  considered  the  case  of  two  points  (discrete) 
prior  and  used  the  ratio  of  posterior  prcbabili  ties  for  malting  the 
decision.  The  criterion  is,  at  the  n th  stage 


accept  if 


p(e-6oiy  < _g_  _ 

p (a=  f en)  i-o 


and  reject  if 


PW-eoiy  > i-x 

- a 


p (e«  e,^  |en) 


The  work  of  Schafer  et  al  (1970,  1971,  1973)  is  an  extensive 
investigation  of  the  design  of  reliability  sanpling  plans  for  exponential 
distribution  based  upon  a prior  distribution  for  6.  The  three  reports 
libelled  Phase  I,  Phase  II  and  Phase  III  are  now  reviewed  in  9cne 
detail.  Phase  I primarily  deals  with  the  fitting  of  a prior  distribution, 
the  objective  being  too  ascertain  if  inverted  gamna  is  a suitable  prior 
to  consider.  Also,  the  requirements  for  the  data  and  monent  estimators 


for  fitting  prior  distribution  are  studied.  On  the  basis  of  failure 
data  obtained  on  different  equipments  they  show  that  the  inverted 
garma  is  a reasonable  prior  to  consider.  Phase  II  contains  a brief 
overview  of  the  available  design  criteria,  cn  the  basis  of  a 
limited  study  the  authors  conclude  that  are  the  proper 

criteria  to  use.  The  report  also  contains  some  discussion  of  test 
criteria  vhen  there  is  a lack  of  agreement  between  the  producer  and 
the  consumer  regarding  the  prior  distribution.  The  methods  of  nodi fving 
the  prior  distribution  in  view  of  additional  data  or  due  to  changes  in 
environment  are  also  considered.  Phase  III  reccmnends  a different 
aet  of  risk  criteria,  namely  P(A)  and  $*,  where  P(A)  is  the  un- 
conditional probability  of  acceptance.  Single  sample  fixed  time 
tests  are  tabulated  for  two  sets  of  criteria  (P<A),  0*}  and  (P(A),  6). 
Also,  plans  are  given  for  the  sequential  approach  due  to  Schafer  and 
Singpurwalla  (1970).  Some  methods  of  updating  the  prior  distribution 
and  acme  tests  to  detect  shifts  in  the  prior  are  also  given  in  Phase  hi. 
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II  TO  V 


REPORTS 


A summary  of  the  work  reported  in  the  technical  reports  entitled 
"Reliability  Acceptance  Sampling  Plana  Based  Upon  Prior  Distribution- 
Part  II  - Risk  Criteria  and  Their  Interpretation,  Part  III  - Implications 
and  Determination  of  the  Prior  Distribution,  Part  IV  - Design  of  Testing 
Plans,  and  Part  V - Sensitivity  Analyses,"  is  given  below. 


Risk  Criteria  and  Their  Interpretation  (Part  II) 

The  definitions  and  the  mathematical,  physical  and  graphical 


interpretations  of  the  following  riric  criteria  are  given. 

1.  The  probability  P(A|6  * 0^)  that  a system  (lot)  with 
mininun  acceptable  MTBF  is  accepted. 

2.  The  probability  P(R|e  ■ 0Q)  that  a system  with  specified 
WTBF  is  rejected. 

3.  The  probability  P(A|6  < 6^)  that  a system  vhich  is  of 
unacceptable  reliability  is  accepted. 

4.  The  probability  P(R|e  i 0Q)  that  a system  of  acceptable 
reliability  is  rejected. 

5.  The  probability  P(0  i 0j^  |A)  that  the  MTEF  of  a system 
which  has  been  accepted  is  less  than  the  mininun  acceptable 
NUF . 
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6.  The  probability  P(6  < eQ|A)  that  the  MTBF  of  a system  which 
has  been  accepted  is  less  than  the  specified  MTBF. 

7.  The  probability  P(e  > eQ|R)  that  the  MTBF  of  a sysfcen 
which  has  been  rejected  is  greater  than  the  specified  MTBF. 

8.  The  unconditional  probability  P(R)  that  a randomly  selected 
system  is  rejected. 

The  interrelationships  between  the  risks  are  explored  and  the  exact 
protection  provided  to  the  producer  and  the  ccnsuner  by  the  use  of 
these  risks  is  determined.  The  choice  of  risk  combinations  that 
best  reflect  the  primary  interests  of  the  producer  and  the  consumer  in 
various  situations  of  practical  interest  is  discussed  at  length. 

Implications  and  Determination  of  the  Prior  Distribution  (Par.;  Ill) : 

This  report  provides  a detailed  discussion  of  the  implications 
of  the  existence  of  a prior  distribution  in  the  context  of  reliability 
acceptance  sampling.  Various  situations  under  which  such  distributions 
can  arise  are  described  and  their  implications  explored.  The  choice 
of  the  functional  form  of  the  prior  distribution  and  the  estimation  of 
parameters  of  this  distribution  for  various  types  of  reliability  data 
are  discussed.  Specifically,  the  prior  for  the  exponential  parameter 
6 is  chosen  to  be  the  two  parameter  inverted  game  and  is  shown  to  be 
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adequate  for  acme  observed  failure  data.  Maxiirun  likelihood  estimation 
of  prior  parameters  is  considered  when  the  failure  data  arise  from 
truncated,  censored,  with  replacement  and  without  replacement  single 
sample  plans  far  systans  and  lots.  A conprehensive  example  is  in- 
cluded to  illustrate  the  estimation  of  prior  parameters  and  their 
variance-oovarianoe  matrix  vhen  data  on  the  nunber  of  failures  in 
fixed  time  is  available. 

Design  of  Testing  Plans  (Part  IV) 

This  report  contains  numerical  and  graphical  procedures  for  the 
design  of  single  sample  truncated  plans  for  systems  and  lots.  The 
graphical  procedure  has  the  advantage  that  it  permits  the  exploration 
of  design  region  to  choose  between  carpeting  designs  under  various 
practiced  constraints.  Several  examples  are  given  to  illustrate  the 
usefulness  of  the  graphical  method.  The  numerical  procedure  can  be 
used  when  the  contour  nomograms  far  the  graphical  procedure  are  not 
available  and/or  an  exploration  of  the  design  region  is  not  considered 


Sensitivity  Analysis  (Part  V) 

In  this  report  vie  examine  the  effects  of  the  uncertainties 
associated  with  the  prior  parameters  cn  the  designed  plans  and  the 
selected  risks.  The  uncertainty  associated  with  the  parameter 
estimates  is  quantified  by  obtainii^j  the  joint  confidence  regions  for 
the  tv*5  parameters  via  simulation.  The  likelihood  plots  and  contours 
of  the  asynptotic  bivariate  normal  density  are  also  examined  in  an 
effort  to  assess  the  effect  of  the  uncertainty  on  the  designed  plans 
and  the  risks. 
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